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ABSTRACT 

Most  detection  algorithms  for  hyperspectral  imaging  applica¬ 
tions  assume  a  target  with  a  perfectly  known  spectral  signature. 
In  practice,  the  target  signature  is  either  imperfectly  measured 
(target  mismatch)  and/or  it  exhibits  spectral  variability.  The 
objective  of  this  paper  is  to  introduce  a  robust  matched  filter 
that  takes  the  uncertainty  and/or  variability  of  target  signa¬ 
tures  into  account.  It  is  shown  that,  if  we  describe  this  uncer¬ 
tainty  with  an  ellipsoid  in  the  spectral  space,  we  can  design  a 
matched  filter  that  provides  a  response  of  the  same  magnitude 
for  all  spectra  within  this  ellipsoid.  Thus,  by  changing  the 
size  of  this  ellipsoid,  we  can  control  the  “spectral  selectivity” 
of  the  matched  filter.  The  ability  of  the  robust  matched  filter 
to  deal  effectively  with  target  mismatch  and  spectral  variabil¬ 
ity  is  demonstrated  with  hyperspectral  imaging  data  from  the 
HYDICE  sensor. 

Index  Terms —  Infrared  spectroscopy,  multidimensional 
signal  detection,  array  signal  processing,  adaptive  signal  de¬ 
tection 

1.  INTRODUCTION 

One  of  the  fundamental  challenges  for  a  hyperspectral  imag¬ 
ing  surveillance  system  is  the  detection  of  subpixel  targets  in 
background  clutter  [1,  2].  The  background  surrounding  the 
target,  which  acts  as  interference,  provides  the  major  obstacle 
to  successful  detection.  Most  hyperspectral  target  detection 
algorithms  are  derived  using  the  following  assumptions 

1 .  The  target  is  characterized  by  a  spectral  signature  with 
known  shape 

2.  The  background  spectrum  follows  a  multivariate  nor¬ 
mal  distribution  with  known  mean  vector  and  covariance 
matrix 
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Fig.  1.  Pictorial  illustration  of  additive  and  replacement  sub¬ 
pixel  target  models  for  hyperspectral  imaging  data. 

3.  For  subpixel  targets  the  background  acts  as  an  additive 
interference. 

The  additive  and  replacement  subpixel  target  models  are  illus¬ 
trated  in  Figure  1 .  In  hyperspectral  imaging  data,  the  target  re¬ 
places  the  background  and  we  have  a  replacement  model;  how¬ 
ever,  for  mathematical  tractability  we  use  an  additive  model 
[2]. 

The  most  widely  used  algorithm  for  hyperspectral  target 
detection  is  the  matched  filter.  The  matched  filter  is  a  lin¬ 
ear  processor  whose  weights  can  be  obtained  using  different 
optimality  criteria.  Indeed,  for  a  target  with  known  spectral 
signature  in  the  presence  of  additive  zero  mean  normal  in¬ 
terference  with  known  covariance  matrix,  the  likelihood  ratio 
processor,  the  maximum  signal-to-noise-plus-interference  ra¬ 
tio  filter,  and  the  minimum  variance  linear  signal  estimator 
have  identical  weights.  Another  criterion  of  optimality,  which 
we  shall  explore  in  this  work,  is  that  the  matched  filter  min¬ 
imizes  the  output  noise-plus-interference  variance  subject  to 
the  constraint  that  the  response  to  the  target  is  equal  to  one. 
This  implies  that  the  matched  filter  has  maximum  response  in 
the  direction  of  the  target  in  the  spectral  space  and  the  smaller 
possible  response  in  any  other  direction.  Unfortunately,  in 
practical  applications,  the  target  signature  is  not  accurately 
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measured  or  the  target  object  exhibits  intrinsic  spectral  vari¬ 
ability.  In  both  cases,  there  is  a  performance  degradation  that 
increases  with  the  measurement  error  or  the  spectral  variability 
of  the  target  signature.  In  practice,  these  assumptions  are  vio¬ 
lated  to  various  degrees,  leading  to  suboptimum  performance. 
Furthermore,  in  most  practical  applications,  the  background 
mean  and  covariance  are  estimated  from  the  available  spectral 
observations.  The  quality  of  these  estimates  depend  on  the 
available  number  of  pixels,  their  spectral  homogeneity,  and 
whether  there  are  contaminated  by  target  pixels. 

2.  THE  OPTIMUM  MATCHED  FILTER 

The  spectral  measurements  obtained  by  a  iT-band  hyperspec- 
tral  imaging  sensor  can  be  arranged  in  vector  form  as 

x=[xi  x2  ...  XK]T  (1) 

where  T  denotes  matrix  transpose.  Let  v  be  a  K  x  1  random 
vector  from  a  normal  distribution  with  mean  \i  and  covariance 
matrix  X  representing  the  background  clutter.  Finally,  let  so 
be  a  K  x  1  vector  representing  the  spectral  signature  of  the 
target  of  interest.  To  simplify  notation,  we  assume  that  /x 
is  removed  from  all  spectra,  that  is,  we  deal  with  zero  mean 
clutter  and  a  “clutter-centered”  target  signature. 

The  optimum  linear  matched  filter  [3] 

y  =  hTx  (2) 

can  be  determined  by  minimizing  the  output  clutter  power 
Var (y2)  =  hTY,h  subject  to  a  unity  gain  constraint  in  the 
direction  of  the  target  spectral  signature 

min/iTX/i  subject  to  hT s0  =  1  (3) 

h 

The  solution  to  (3)  is  given  by 


Actual  target 


Fig.  2.  Illustration  of  robust  matched  filter  design  principle 
using  two  spectral  bands. 

3.  THE  ROBUST  MATCHED  FILTER 

In  this  section,  we  shall  use  the  theory  of  robust  Capon  beam- 
former  (RCB)  [5]  to  develop  a  robust  matched  filter  that  takes 
measurement  errors  and  the  spectral  variability  of  hyperspec- 
tral  target  signatures  into  consideration.  The  robust  matched 
filter  (RMF)  addresses  robustness  to  target  signature  errors  by 
introducing  an  uncertainty  region  constraint  into  the  optimiza¬ 
tion  process.  To  this  end,  assume  that  the  only  knowledge  we 
have  about  the  signature  s  is  that  it  belongs  to  an  uncertainty 
ellipsoid 

(s  -  s0)TC_1(s  -  So)  <  1  (5) 

where  the  vector  s0  and  the  positive  definite  matrix  C  are 
given.  In  most  hyperspectral  target  detection  applications,  it 
is  difficult  to  get  sufficient  data  to  reliably  estimate  the  full 
matrix  C.  Therefore,  we  usually  set  C  =  si,  so  that  (5) 
becomes 

||s-So||2<£  (6) 


which  is  the  formula  for  the  widely  used  matched  filter. 

In  the  array  processing  area,  where  the  data  and  filter  vec¬ 
tors  are  complex,  the  matched  filter  (4)  is  known  as  the  standard 
Capon  beamformer  (SCB)  [4]. 

In  practice,  the  clutter  covariance  matrix  X  and  the  tar¬ 
get  signature  s0  have  to  be  estimated  from  the  available  data. 
It  turns  out  that  the  matched  filter  (4)  is  sensitive  to  signa¬ 
ture  errors  and  the  quality  of  the  clutter  covariance  matrix. 
Therefore,  the  development  of  matched  filters  that  are  robust 
to  signature  and  clutter  covariance  errors  is  highly  desirable. 
This  problem  has  been  traditionally  dealt  with  using  a  diagonal 
loading  approach  or  an  eigenspace-based  approach.  However, 
in  both  case  the  selection  of  diagonal  loading  or  the  subspace 
dimension  is  ad-hoc  [4], 


where  e  is  a  positive  number.  These  ideas  are  illustrated  in 
Figure  2.  It  has  been  shown  in  [5]  that  the  RMF  can  be  obtained 
as  the  solution  to  the  following  optimization  problem 

min st'£~1s  subjectto  ||s  —  so||2  <  £  (7) 

s 

It  turns  out  that  the  solution  of  (7)  occurs  on  the  boundary  of  the 
constraint  set;  therefore,  we  can  reformulate  (7)  as  a  quadratic 
optimization  problem  with  a  quadratic  equality  constraint 

minsTX_1s  subjectto  ||s  —  s0||2  =  £  (8) 

s 

This  problem  can  be  efficiently  solved  using  the  method  of 
Lagrange  multipliers  [6].  The  solution  involves  an  estimated 
target  signature 

s  =  /3(£_1  +  f3I)~1so  (9) 
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which  is  subsequently  used  to  determine  the  RMF  by 


hp  = 


xr1^ 

sTH-'s 


(10) 


The  Lagrange  multiplier  (3  >  0  can  be  obtained  by  solving  the 
nonlinear  equation 


4(/+(0s)-2So  =  yy 


Sk 


=  £ 


(11) 


where  and  Sk  are  obtained  from  the  eigen-decomposition 

K 


s  =  qaqt  =  Y  xkqkql 


k=  1 


and  the  orthogonal  transformation 
s  =  Qts0 


(12) 


(13) 


The  solution  of  (1 1)  can  be  easily  done  using  some  nonlinear 
optimization  algorithm,  for  example,  Newton’s  method. 

Finally,  we  note  that  the  RMF  (10)  can  be  expressed  in 
diagonal  loading  form  as  follows 


(s+r1/)-1*) 

sJ(£  +  /?-1J)-1£(£  +  /?-1J)-1s0 


(14) 


where  1  is  the  loading  factor  [5]  is  computed  from  (11). 

Figure  3  illustrates  the  validity  of  the  optimization  ap¬ 
proach  leading  to  the  RMF.  We  note  that  the  RMF  is  obtained 
as  a  standard  MF  for  a  modified  target  signature.  As  expected 
the  “assumed”  target  signature  specifies  the  center  of  the  un¬ 
certainty  region,  whereas  the  modified  signature  “touches”  the 
boundary  of  the  uncertainty  region. 


4.  EXPERIMENTAL  INVESTIGATION 

To  illustrate  the  validity  of  the  RMF  approach,  we  use  airborne 
hyperspectral  imagery  data  collected  by  the  HYDICE  sensor  at 
the  U.S.  Army  Aberdeen  Proving  Grounds,  Maryland,  on  24 
August  1995.  HYDICE  collects  calibrated  (post-processed) 
spectral  radiance  data  in  210  wavelengths  spanning  0.4  to  2.5 
/xm  in  nominally  10-nm  wide  bands.  After  removing  the  at¬ 
mospheric  opaque  bands,  we  end  up  with  155  usable  spectral 
bands.  Figure  4  shows  an  image  of  the  ground  surface  and  the 
available  target  signatures  obtained  by  ground  measurements. 
The  target  signature  so  is  determined  by  the  mean  of  the  target 
spectra  shown  in  Figure  4.  Clearly,  due  to  environmental  and 
target  variability  there  is  a  mismatch  between  the  spectra  of 
the  in-scene  target  pixels  and  the  spectral  signature  used  by 
the  matched  filter.  Figure  5  shows  the  detection  statistics 
in  the  neighborhood  of  the  four  target  objects  for  a  standard 
MF  and  a  RMF  with  e  —  0.01.  We  note  that  the  responses  of 
the  two  filters  are  almost  identical.  Using  smaller  values  for 
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Fig.  3.  Illustration  of  robust  matched  filter  when  there  is  a 
target  signature  mismatch.  The  algorithm  uses  the  available 
signature  specifying  the  center  of  the  uncertainty  region,  to 
produce  a  “robust”  signature  that  is  subsequently  used  to  de¬ 
termine  the  RMF  coefficients. 


Fig.  4.  Color  image  representing  the  hyperspectral  data  from 
the  HYDICE  sensor  data  cube  and  a  plot  of  the  available  spec¬ 
tral  signatures  for  the  target  of  interest.  The  red  curve  repre¬ 
sents  the  mean  target  signature. 


£  results  to  identical  detection  statistics.  In  Figure  6,  where 
we  have  increased  the  uncertainty  to  s  =  0.1,  we  note  that 
the  RMF  “picks-up”  more  target  pixels  around  the  third  tar¬ 
get  object.  This  illustrates  the  trade-off  between  “selectivity” 
(small  e)  and  “collectivity”  (large  e)  of  the  algorithm.  Clearly, 
a  “less  selective”  algorithm  may  “pick-up”  more  targets  and 
false  alarms.  Figure  7  shows  the  signature  used  by  the  MF 
and  the  “robust”  signature  created  by  the  RMF.  Clearly,  the 
robust  signature  s  can  be  used  to  “robustify”  other  detection 
algorithms,  like  ACE,  GLRT,  and  AMF  [2].  Due  to  the  high 
dimensionality  of  hyperspectral  imaging  data,  covariance  reg¬ 
ularization  is  another  practical  necessity,  which  can  be  mean¬ 
ingfully  addressed  using  the  robust  matched  filter  approach. 
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Fig.  5.  Detection  statistics  of  a  standard  MF  and  a  RMF  with 
small  target  uncertainty. 


Fig.  6.  Detection  statistics  of  a  standard  MF  and  a  RMF  with 
large  target  uncertainty. 


5.  SUMMARY 

Classical  matched  filter  is  sensitive  to  target  signature  miss- 
match  and  background  covariance  invertibility.  Covariance 
matrix  regularization,  through  diagonal  loading,  provides  an 
ad-hoc  method  to  address  both  problems  [4],  In  this  paper, 
we  have  described  a  robust  matched  filtering  approach  that 
relates  systematically  target  signature  uncertainty  to  covari¬ 
ance  matrix  regularization  and  provides  the  tools  to  (a)  study 
robustness  of  target  detection  algorithms  and  (b)  develop  ro¬ 
bust  and  effective  detection  algorithms  for  targets  with  spectral 
variability  or  uncertainty.  This  technique  ia  particularly  useful 
in  hyperspectral  imaging  applications  where  target  variability 
can  be  bounded  by  angular  and  sensor  noise  considerations. 
More  experimental  results  will  be  presented  at  the  conference. 
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Fig.  7.  The  RMF  algorithm  modifies  the  target  signature  to 
produce  a  new  signature  that  is  used  to  generate  the  RMF 
coefficient  vector. 
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